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ABSTRACT 

Starting wiOi an assumed ideal network having perfect clocks at eveiy node and 
known fixed transmission delays between nodes, the ^ects of adding tolerances 
to both transmission delays and nodal clocks is described. 

The advantages of controlling tolerances on time rather than frequency are dis- 
cussed. Then a conc^ is presented for maintaining these tolerances on time 
dirou^iout the network. This concept, called time reference distribution, is a 
systematic technique for distributing time reference to all nodes of the networic. 

R is reliable, survivable and possesses many other desirable characteristics. 
Some of its features such as an eccellent self monitoring C£q>ability will bepointed 
out. 

Some preliminary estimates of the accuracy that might be e}q>ected will be de- 
veloped and there will be a brief discussion of the impact iq>on communication 
system costs. 

Time reference distribution is a concept that appears very attractive to the 
author. It has not had esqierimental evaluation and has not yet been endorsed 
for jse in any communication network. 


BACKGROUND 

Time division multiplexing and/or switclaig which is often desirable in a digital 
communication network presents timing problems. These are problems of a 
type not experienced in analog networks using frequency division multiplexing 
and q;>ace division switching. 

For time division multfolexing and switching in a digital communications ^stem, 
each bit from an incoming bit stream must be available to fill its time slot when 
it is needed. In an ideal system, exact time would be available at every trans- 
mission node and there would be known, fixed delays between nodes. Under 
these conditions, the system could be designed so that each bit arrives at the 
time division multiplexer or switch at the desired moment. 
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However, in the real world this ideal situation does not exist. There are vari- 
ations in transmission delay between nodes. These can be allowed for by using 
"elastic" storage buffers between the receivers located at each node and the 
associated time division multiplexing or switching equipment. Bits which arrive 
too soon are stored in these buffers until are needed. The buffer storage 
also serves as a reservoir to siqpply bits when incoming bits arrive late. At 
any given data rate each bit of buffer storage represents an increment of time 
tolerance. 

ff, in addition to variations in transmission delay between nodes, there is a 
tolerance on time at each node, the buffers may be enlarged to also accommo- 
date the nodal timii^ errors. Technology is present^ available, MOS micro- 
circuit first-in first-out (FIFO) serial buffers used by the computer inchistry, 
that can economical^ provide hundreds of microseconds of variable delay stor- 
age. A bit read into the iiq>ut of these devices prc^agates by itself to the unfilled 
bit location n^rest the output. When data is read out, die remainit^ stored 
data automatically shifts toward the cmtput. The input and output clocks are in- 
dqpeiulent. Unless timing is used for functions other than keeping die bits in the 
proper sequence, the acc^table timing tolerance for the communications sys- 
tem is limited onfy by the accqitable number of bits of buffer storage and the 
data rate, i. e. , the accq^ble variable time delay of the buffers. 

A tolerance on nodal frequency (instead of on nodal time) is equivalent to a tol- 
erance on the rate at which an error in time may accumulate. A frequency tol- 
erance will permit a boundless time error; therefore, the interval of time over 
which an error is permitted to accumulate must be specified. The amount of 
buffer storage required by the communications system is determined by the 
accumulated time error rather than the rate at which it accumulates. As a re- 
sult, whenever a frequency tolerance is specified, a reset interval must also be 
specified. For a system whidi is to be in continual use over a long period of 
time, it is preferable to control time rather than frequency. 

One presently planned communications system fTRI-TAC) will employ a tolerance 
on frequency rather than time. In this system an atomic standard is used at each 
node to maintain the required frequency tolerance. Buffer storage sufficient for 
a 24 -hour period is provided. The buffers are dumped and reset as required. 

Another technique not requiring a tolerance on time is called mutual synchron- 
ization, in which each node adjusts its own frequency to reduce the timing error 
between itself and some average of the rest of the network^* Removal of 
any node of the network still leaves a ^nchronized network, but a transient dis- 
tuii>ance in one part of the network will propagate to other parts of the network. 
Any one clock can perturb the system frequency. 
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A technique called pulse stuffing^, wdiich ck>es not require synchronism, has been 
developed for point -to^int time division transmission. In pulse stuffing, mul- 
t4)le asynchronous signals are padded with dummy pulses to bring them to a 
common bit rate for time division multiplexing. After multiplexing at diis com- 
mon rate, transmission of the combined signals and demultiplexing at the re- 
ceiver, the dummy pulses are moved to return each signal to its original asyn- 
chronous rate. Although this pulse stuffing technique aqqpears economical for 
point-to-point applications, it does not sqipear economically attractive for a time 
division switched network. If a large number of channels are combined synchro - 
nousty at the transmitting end, the pulse stuffing technique is an attractive method 
of mult^lexing many of the resulting higher rate channels. The cost of stuffing 
is shared among all of the individual channels that are synchronously combined 
to form die hi^er rate iiqNit to the pulse stuffing equfoment. The sig^ls that 
arc original^ synchronous at the input of the point-to^ioint transmission system 
remain synchronous at its output. In a switched netwoik each member of a gnroiq> 
of synchronous channels at a single origin may have a different destination. Each 
mi^t be grouped with signals originating from other points in the network so that 
members of the new group will not be synchronous. They no lot^r will be able 
to share the same pulse stuffing and destuffing equipment. Pulse stuffing on an 
individual channel basis thus becomes necessary in an unsynchronized switched 
digital network. This implies expense. 

Perhsqis the most obvious of all synchronizing methods is a master-slave tech- 
nique in which all nodes of the networic are slaved, either directly or throu^ 
intermediate nodes, to a single master clock. The reliability of this technique 
and its survivability in a military environment have been questioned. However, 
several commercial communications ^sterns plan to use it^* 

From this background discussion it can be seen that a close time tolerance at 
every node of a digital communications network enq>loying time division multi- 
plexing and/or switching would be desirable if an economical, reliable and sur- 
vivable method could be found. The Time Reference Distribution technique is 
offered as a possibility. After the technique has been ejqplained some of its 
advantages will be listed. Some of the listed advantages result from maintaining 
a close time tolerance. 


TIME REFERENCE DISTRIBUTION 

The Time Reference Distribution technique^ for digital communications network 
timing provides an accurate clock at each node. Accuracy is maintained Ity 
occasional correction of nodal clocks using time reference information trans- 
mitted over every link of the netwoik in such a way as to be independent of trans- 
mission delays. Since a timing path is associated with every communications 
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liok, the only way for any node to be isolated from timing informatk>n is for it 
to have no oommunicatioiis with the remainder of die network. 

For die Time Reference Distribution technique, all nodal clocks are rank 
ordered, i. e. , sequentially arranged in order of priority. Time reference 
information is passed in b<^ directions over every liidc. Time comparison 
signals to be used for time difference measurement can be siqperimposed on 
the cbta stream or its carrier by a eqiecial modulation technique. Alternatively, 
die frame ^nchronizatkm code may be used for diis purpose. In addition to 
diese basic time conqiarison signals, four types of data are transferred from 
each node to the node at die other aid of each link. These data are: 

1. The time difference between the local clock and die clodr at the other 
end of die link as observed at the local clock (this time difference in- 
cludes transmission delay). 

2. The rank of the node used as the master time reference for the local 
clock. 

3. The merit of the transmission path over 'vfaich the time reference in- 
formation is passed from the reference clodc to the local clock. 

4. The rai& of the local clock. 

The first datum, i. e. , the clodc difference information, is used to make the time 
reference "independent" of transmission delay. Each node measures the time 
difference betweoi its own clock and that at the other end of each link. This 
measurement is transmitted to the other end of the link so that both measure- 
ments are available at both ends of each link. To illustrate its use, let T^ be 
the time of die clock at node A, and let Tg be the time of the clodc at node B. 

Let be the transmission delay from node A to node B, and let Dg^ be the 
transmission delay from node B to node A. Then the time difference measured 
at node A is Ka = T^ - (Tb - Dba) and the time difference measured at node B 
is Kb = Tg - (T^ - ^ab)* Subtracting Ka from Kg and dividing by 2 gives 



When the transmission delays in the two directions are the same, they cancel, 
giving the time difference between the two nodes independent of transmission 
delay. Adding Ka to Kg gives 


B '*■ ^BA ~ *^A 


( 2 ) 
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When D is equal to D ba« the transmission delay between nodes is also avail- 
able by dividing (K^ K^) fay 2. Only a few bits of information per minute are 
required on each Unk to transfer the required timing data. Although timing 
difference measurements are made quite frequently, the clock time corrections 
may be made much less frequently because time errors will accumulate very 
slowly. 

The other three data are used with a simple set of rules to allow each node to 
unambiguously select its time reference from the incoming link that should pro- 
vide Uie best reference. Other cross checks are available to determine whether 
this path is reliable. If it is not reliable, an alternate choice can be made by 
ai^lyii^ the same set of rules. The basic rules are as follows: 

Rule 1 . The time reference for the local clock is taken from the link 

coming from the node which uses the hipest raidcing clock as its 
time reference. However, if the local clock outranks the others, 
the local clock is used as refer^ce. ff any two links come from 
nodes referencing the same highest rankii^ clock, the cr.Herk>n 
is inconclusive. In a tmrmally operating network, all codes will 
be referencing the same master time reference so that this cri- 
terion will normally be inconclusive and rule 2 must be ai^i''>d. 

Rule 2 . When the first test is inconclusive because the links come from 
nodes all referencing the same highest ranking cl^ck, select the 
one that comes over the highest merit transmission path, i. e. , 
the one with the best time transfer capability. If two or more 
come over transmission paths with the same highest merit rating, 
this test will also be inconclusive and rule 3 must be ai^lied. In 
most cases this will be a conclusive test. 

Rule 3 . When the first and second tests are both inconclusive, select 
from those links with time reference coming from the same 
highest ranking clock over paths with the same highest merit 
rating the one that comes from the highest ranking, directly con- 
nected node. 

Nodes carry the same ranking as the nodal clock that they are using at the 
moment. Multiple clocks of different rank may be provided at an individual 
node for reliability. Considerations in ranking the netwoik clocks include the 
quality of the clock and the merit (time transfer capability) of communications 
paths to the hi^er ranking nodes. Those nodes equipped with cesium beam 
clocks will normally be ranked higher than those equqjped with rubidium clocks 
which in turn will be hi^er than those equij^ed with quartz clocks. Of those 
nodes with cesium beam clocks those with the best time reference path to the 
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highest ranking nodes will normally outrank those with poorer paths* e. g. , those 
with a direct high resolution satellite path would normally outrank those with 
other types of long transmission paths. A node with more than one type of 
clock will be identified in rank by the particular clock in use at the moment. 

Each transmission link will be assigned a merit (or perhaps more {appropriately— 
demerit) value which d^ends upon its length and the transmission medium. 

Each node is informed of the accumulated transmission path merit for the time 
reference used at the other end of the link (one of the four pieces of information 
exchanged). Using the characteristics of the link over ^ich the time reference 
information is received, the merit rating is further degraded before it is used 
at the local node. Thus, the path merit rating is increasingly d^raded as the 
time reference information is passed throu^ more nodes of the network. 

Examination of the rules above shows that they assure that there will be no sys- 
tem closed loops to contribute to system instability. This is true because of 
the additional degradation of the path merit rating as additional links are tra- 
versed. Any return path must have a lower merit rating and therfore cannot be 
selected as the reference. The rules assure that every node will have a time 
reference signal so long as any one communications link to the node is still 
useful. These same rules permit the next ranking node to take over as the 
reference for the system if the highest ranking node becomes inoperable. They 
also direct that the highest ranking node in any isolated portion of the network 
will be selected as its reference. 

The nodal clock is used for all time division mult4>lexing and switching functions 
at the node. It also clocks the bits out of the "elastic" storage buffers associ- 
ated with each received link and times the data on every outing data link. The 
receivers for every incoming link derive their time from the received signal. 
(This is usually done by providing a phase shifted signal from the nodal clock 
and making it coincide with the timing of the received signal. This takes ad- 
vantage of the stability of tlte nodal clock. ) This receiver timing is used to 
demodulate the received signal and clock bits into the "elastic" buffers; thus 
bits are independently clocked into the buffers by the received timing and out of 
the buffers by the nodal clock. 


SOME ADVANTAGES OF THE TECHNIQUE 

1. By referencing one node of the network to a precise time source, such 
as the Naval Observatory, an accurate time reference becomes available 
throu^out the network. 


510 



2. Since the rules for selecting the reference sources prevent the establish- 
ment of astern closed loops, there is no problem with system stability. 

3. It has st 4 >erior self -monitoring capability. Every node receives time 
reference information from every directly connected node; any disagreement 
in these time references at aqy node indicates a potential problem. This indi- 
cation can occur while the system is functioning quite satisfactorily. It can be 
used to initiate maintenance procedures so that the problem can be corrected 
before aoy degradation in system performance can be detected. 

Each node can have transmission delay information available for every connected 
link and the status of buffer contents can also be available for the same links. 

Any incompatibility among them can indicate a potential problem and permit 
corrective action to begin early. Any sudden change in (1) the time refer^ce 
information received over any link, (2) measured transmission delay of any 
link, or (3) ffie status of Iniffer contents can indicate a potential problem. 

4. Redundant timing information can serve as a powerful trouble-shooting 

tool. 

5. Since the effect of transmission delay on timing is mostly cancelled on 
every transmission link and everything is retimed at every transmission node, 
a high d^ree of iK)dal environmental isolation is provided; 1. e. , the environ- 
mental effects upon the time delay of any transmission link are removed and not 
permitted to propogate from node to node. 

6. A fixed, accurate, time reference is a familar concept easily grasped 
by operating and maintenance personnel. 

7. The technique places limits on the size of "elastic" storage buffers which 
are required at each node to absorb variations in transmission path delays and/ 
or nodal timing errors. 

8. It requires no resetting of buffers such as that required to compensate 
for time differences between ind^endent clocks. 

9. The availability of more accurate time will encourage innovation of 
future applications which will be of benefit to the overall effectiveness of the 
communications system and its users. There will be a growing need for ac- 
curate time among several government agencies^. Availability always stimu- 
lates need which in turn will generate new capabilities and operational improve- 
ments which were initially implanned. 
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10. Some major navigation systems are already being coordinated in ac- 
curate time. Overall system coordination among all of these systems and a 
communications networic should be synergistic, providing each with benefits 
beyond its individual contribution. 

11. A by-product of the Time Reference Distribution technique is that ac- 
curate time at each node of the network can easily be made available to external 
users. 

12. All normal decision processes and time corrections can be made auto- 
matic and do not require human intervention. 

13. System iteration is not dependent iqx>n the continued operation of any 
node. Time reference is always available to all surviving nodes that could make 
use of it. 

14. The system is compatible with all external references which are ac- 
curately related to universal time. Any of these external time references can 
be utilized and blended into the system by applying the same rules that are ap- 
plied to the nodes of the network. Each external time reference can be as- 
signed a rank and a transmission path merit. However, the method of correct- 
ing for transmission path delay would normally be different because the duplex 
commimications path would not be available with most of these external time 
references. External references such as Loran-C could be used on an interim 
basis during development of the complete Time Reference Distribution system 
and could phase into participation with the Time Reference Distribution system 
as the complete system becomes operational. 

15. Time Reference Distribution permits the convenient collection of much 
valuable engineering information, including statistical information about trans- 
mission time delay of the individual links and any variation in time reference 

as received over different paths. This information could be very valuable in the 
development of future systems of many different types. 

16. The Time Reference Distribution technique is capable of effectively 
utilizing future technological improvements to provide greater precision without 
the major system redesign that other timing methods might necessitate. It also 
has the capability of making use of the greater precision thus provided. 

17. The Time Reference Distribution technique provides accurate time 
reference information at the nodes. This information can be used to evaluate 
the performance of nodal clock oscillators. All information to predict future 
drift rates and their rate of change can be made available. This information 
can be used to compensate for the predicted drift of the oscillators and provde 
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a resulting clock of much higher accuracy than could otherwise be obtained in a 
similar price range. This ability to greatly enhance the effectiveness of lower 
cost oscillators could be significant advantage. 

18. If the timing for all link receivers at a node is derived by phase shifting 
a signal from the veiy stable reference of an accurate nodal clock, the time to 
reacquire synchronization after a deep fade can be minimized. The technique 
integrates naturally with the Time Reference Distribution technique and, if de- 
sired, can be incorporated into the time difference measurement (first of the 
four pieces of Information exchanged between nodes). 

19. Time Referaice Distribution £q>pears to have a svq^erior flexibility for 
handling unforeseen requirements as th^ arise. 

20. Fall back modes of (deration are provided and could be extended. 
Whenever the incoming link that is being used for a node’s time reference fails, 
the node selects the next best link as its time reference. This process can con- 
tinue until all incoming links have failed and there is no longer need for a time 
reference. The same procedure provides for failures of other nodes since they 
are equivalent to liidc failures as far as incoming signals are concerned. Assume 
that some failure of the timing system should occur independent of the data trans- 
mission system so that the data transmission system would continue to function 
but lacked time reference information. The affected node could fall back to an 
ind^endent clock mode of operation (requiring periodic or automatic resetting 

of buffers at die other end of each link). 


DIFFERENCE IN TRANSMISSION TIME DELAYS IN OPPOSITE DIRECTIONS 

In the Time Reference Distribution system presented here, timing information 
is passed in both directions over every transmission link. This information is 
used to permit the time provided by the two clocks at the ends of the transmis- 
sion link to be directly compared by cancelling the time delays of the transmis- 
sion link. The cancellation of propagation delays depends on the assumption 
that the transmission delay is the same in bodi directions over the link. A 
question naturally arises as to whether this is a good assumption— particularly 
about over-the-horizon tropospheric scatter transmission that depends on bend- 
ing and scattering of the electromagnetic waves. The multipath character of 
troposcatter transmission causes substantial frequency selective fading and 
intersymbol interference on digital links. These characteristics appear to 
make it somewhat questionable as a time reference distribution medium. Well 
known nonreciprocal delays in HF ionospheric propagation are attributed to the 
wave passing throu^ an ionized medium in the presence of the earth's magnetic 
field. Many researchers agree that there is no comparable mechanism for 
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tropospheric transmission whereby the propagation delays in opposite directions 
over the same path at the same time and frequency should not bethesame^* 

No record of actual measurements of delays in both directions between the same 
pair of terminals at the same time for trq>o8pheric scatter have been '• cated. 
Because there is no known mechanism for making the tropospheric medium non- 
reciprocal, any differences in transmission delays that might occur in the two 
directions would be attributable either to the terminal equipment or to different 
paths being used in the two directions. The difference in paths could be attri- 
buted to different antenna positions or to the use of different frequencies. In 
either case, the difference in propagation delay times between two independent 
paths in opposite directions should be the same as the difference between two 
independent paths in the same direction. Measurements have be^ made of the 
difference in time delay between two independent tropospheric paths 168 miles 
long at 900 MHz^^. The stamlard deviation of the relative delay was found to be 
22 nanoseconds. Phase data observed over a 230 km path^^ indicated that random 
variations of a 900 MHz signal over several minutes rarely exceed about 10 
radians. This corresponds to about 5 nanoseconds at the 900 MHz frequency. 

The 5 nanosecond observations of^^ are based on phase fluctuations of a 
single carrier frequency, while the 22 nanosecond deviation from^^ is based 
on correlation measurements on simultaneously transmitted, pseudo -random - 
modulated PSK signals. The 22 nanosecond standard deviation seems to be the 
prefereable reference point, since it was measured more nearly in the form of 
the desired sq)plication. Note from equation (1) that the error in time measure- 
ment is only half as great as the difference in transmission times in the two 
directions. 
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The random fluctuation of the differential time delay between two independent 
paths may be erq)ected to contain frequency coit^onents of many cycles per 
minute. By averaging the measurements over several minutes the resulting 
average measurement should have a standard deviation which is only a small 
fraction of the 22 nanoseconds measured in the experiment. The Interval be- 
tween clock corrections for the Time Reference Distribution system may be 
quite long because stable clocks are used. Therefore, the time measurements 
may be averaged over long periods, making it possible to almost completely re- 
move the effects of fluctuations in the propagation medium from the time ref- 
erence measurement. The most significant errors could be associated with 
equipment rather than the propagation medium. The stability of time delays in 
the equipment should be given consideration and tolerance in time delays among 
units of the same type should be minimized. 
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A CONSERVATIVE PRELIMINARY ESTIMATE OF ACCURACY 


As previously mentioaed, a troposheric traasmission link is probably one of the 
more difficult types of transmission link for time transfer because of its multi- 
path characteristics. If we use the 22 nanosecond standard deviation mentioned 
previously as a starting point we may reach some rough estimates of the accuracy 
that might be obtained from a Time Reference Distribution system. 

Since the delay difference may be expected to contain some higher frequency 
components, averaging over several minutes should provide a much lower stand- 
ard deviation than 22 nanoseconds. The timing error due to differences in 
transmission delays in the two directions is only half the difference in transmis- 
sion delays. Assuming that there is no measurement averaging, the standard 
deviation of the timing error is 11 nanoseconds. It should be better than this in 
practice where averaging would be used Allowing ±4 standard deviations for the 
tolerance range makes the potential accuracy ±44 nanoseconds. Allowing an 
additional ±156 nanoseconds (much more than that allowed for the particularly 
severe tropospheric scatter medium) for error contributions of the equipment 
employed gives a total time reference transfer tolerance of ±200 nanoseconds 
for a tropospheric scatter link. If the time transfer errors of all links are 
random and independent of all other links, the tolerance for a tandem connection 
should be the square root of the sum of the squares of the tolerances of the in- 
dividual links. In a highly connected network, the largest number of tandem time 
transfers required should be a small percentage of the total number of nodes in 
the network. Assuming that the number of tandem time reference transfers does 
not exceed 100 and all tolerances in the path are the same, the overall tolerance 
for the tandem path will be VlOO = 10 times the tolerance for any individual link. 
If all links have a 200 nanosecond tolerance, then the time at any node in the net- 
work will be within 2 microseconds of the time at any other node. 

This should be a conservative estimate. It is quite unlikely that any network 
would be 100 percent tropospheric scatter links, and line of sight microwave 
links are much better for time transfer. (Only 18 percent is trcposcatter in the 
DCS in Europe while over 63 percent is line-of-si^t microwave*'^. ) Even for 
tropo links the propagation time variation of the transmission medium would be 
largely eliminated by averaging over a significant perl d of time. The ±156 
nanoseconds allowed for error contributions of the equipment on each link is very 
large for broadband microwave equipment. Two -micro second accuracy between 
any two nodes of the network should be a desirable goal that is both readily 
achievable and useful. 
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CONCLUSIONS 


The Time Reference Distribution system will not only satisfy the timing require- 
ments of a digital time division communications system, but will provide a large 
number of additional advantages. 

The viewpoint should not be too narrow when considering the merits of a timing 
technique for a digital time division communications system. In addition to 
keeping the bits in the proper sequence, monitoring and testing the system should 
be ^ven careful consideration. Other uses for timing within the system should 
be considered along with timing relationships external to the network. Under this 
fype of evaluation. Time Reference Distribution should rank very hi^. A large 
communications network that distributes accurate time for its own use should be 
a natural vehicle for coordinating the maqy other users of accurate time. 
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TIME REFERENCE DBTRIBUTION FOR A 
TIME DIVISION COMMUNICATION NETWORK 


TOLERANCE CONSIDERATIONS 


1. EXACT TIME AT EACH NODE, (unrealistic) 

FIXED DELAYS BETWEEN NODES, (unrealistic) 

2. EXACT TIME AT EACH NODE, (unrealistic) 

TOLERANCES ON VARIABLE DELAYS BETWEEN NODES. 

3. TOLERANCES ON TIME AT EACH NODE. 

TOLERANCES ON DELAYS BETWEEN NODES. 

4. TOLERANCES ON FREQUENCY AT EACH NODE. 

TOLERANCES ON DELAYS BETWEEN NODES. 

5. TIME OR FREQUENCY NOT DIRECTLY CONTOLLED. 
TOLERANCES ON TIME DIFFERENCES BETWEEN CONNECTED 
NODES. 
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Available Capacity, 
Increases As Bits Are 
Decreases As Bits Are 



FIFO BUFFER ANALOGY 


Removed, 

Added, 
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1. EXACT TIME AT EACH NODE. 0inrealistic) 

FIXED DELAYS BETWEEN NODES, (unrealistic) 

2. EXACT TIME AT EACH NODE. Ouurealistic) 
TOLERANCES ON VARIABLE DELAYS BETWEEN NODES. 

3. TOLERANCES ON TIME AT EACH NODE. 

TOLERANCES ON DELAYS BETWEEN NODES. 


4. TOLERANCES ON FREQUENCY AT EACH NODE. 
TOLERANCES ON DELAYS BETWEEN NODES. 


5. TIME OR FREQUENCY NOT DIRECTLY CONTROLLED. 

TOLERANCES ON TIME DIFFERENCES BETWEEN CONNECTED 
NODES. 
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TOLERANCE CONSIDERATIONS 

1. EXACT TIME AT EACH NODE. (unrealisUc) 

FIXED DELAYS BETWEEN NODES. (Unrealistic) 

2. EXACT TIME AT EACH NODE, (unrealistic) 
TOLERANCES ON VARIABLE DELAYS BETWEEN NODES. 

3. TOLERANCES ON TIME AT EACH NODE. 

TOLERANCES ON DELAYS BETWEEN NODES. 

4. TOLERANCES ON FREQUENCY AT EACH NODE. 
TOLERANCES ON DELAYS BETWEEN NODES. 


5. TIME OR FREQUENCY NOT DIRECTLY CONTROLLED. 

TOLERANCES ON TIME DIFFERENCES BETWEEN CONNECTED 
NODES. 


TIME REFERENCE DISTRIBUTION 


• ALL NODES HAVE ONE OR MORE CLOCKS 


• EACH COMMUNICATION PATH IS A TIME REFERENCE PATH 


• ALL CLOCKS HAVE RANK ORDER 


• TIMING INCLUDED IN FRAME SYNC OR SUPERIMPOSED ON DATA 


• FOUR TYPES OF DATA ARE TRANSFERRED OVER EVERY LINK 

a) TIME DIFFERENCE BETWEEN REMOTE CLOCK AND 
LOCAL CLOCK AS OBSERVED AT LOCAL CLOCK 

(2) RANK OF MASTER TIME REFERENCE USED FOR 
LOCAL CLOCK 

(3) MERIT OF TRANSMISSION PATH FROM MASTER 
REFERENCE 


(4) THE RANK OF THE LOCAL CLOCK. 
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TIME REFERENCE DISTRIBUTION 


• ALL NODES HAVE ONE OR MORE CLOCKS 


• EACH COMMUNICATION PATH IS A TIME REFERENCE PATH 


• ALL CLOCKS HAVE RANK ORDER 


• TIMING INCLUDED IN FRAME SYNC OR SUPERIMPOSED ON DATA 


• FOUR TYPES OF DATA ARE TRANSFERRED OVER EVERY LINK 

a) TIME DIFFERENCE BETWEEN REMOTE CLOCK AND 
LOCAL CLOCK AS OBSERVED AT LOCAL CLOCK 

(2) RANK OF MASTER TIME REFERENCE USED FOR 
LOCAL CLOCK 

(3) MERIT OF TRANSMISSION PATH FROM MASTER 
REFERENCE 


(4) THE RANK OF THE LOCAL CLOCK. 


SELECTION RULES 

Rule 1: SELECT REFERENCE SOURCE FROM HIGHEST RANKING 

CLOCK 

Rule 2i IF MORE THAN ONE PATH FROM SAME HIGHEST 

RANKING CLOCK, SELECT REFERENCE FROM HIGHEST 
MERIT PATH 


Rule 3j IF MORE THAN ONE PATH OF THE SAME HIGHEST 

MERIT RATING, SELECT ONE FROM HIGHEST RANKING 
DIRECTLY CONNECTED NODE. 
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TIMING COMPARISON BETWEEN NODES 


T^ = TIME OF CLOCK AT NODE A 
Tg = TIME OF CLOCK AT NODE B 

Dab = TRANSMISSION DELAY FROM NCR>E A TO NODE B 

Dab = TRANSMISSION DELAY FROM I^DE B TO NODE A 

TIME DIFFERENCE MEASURED AT NODE A 
Ka = Ta - (Tb - Dba) 


TIME DIFFERENCE MEASURED AT NODE B 
^ Tg - (Ta - Dab) 


TIME DIFFERENCE BETWEEN CLOCKS 



TRANSMISSION DELAY 

(2) Dab + DgA = Ka + Kb 
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CONSERVATIVE PRELIMINARY ESTIMATE OF ACCURACY 

22ns « STANDARD DEVIATION OF TRANSMISSION 
BETWEEN TWO INDEPENDENT 168 MILE 
TROPO LINKS 

11ns = STANDARD DEVIATION OF RESULTING TIMING 
TIMING ERROR IF NOT REDUCED BY 
AVERAGING 

4Xllns = 44ns = ALLOWED TOLERANCE FOR 
PROPAGATION 

156ns = VERY LAX TOLERANCE FOR EQUIPMENT 


44ns+156ns = 200ns = TOLERANCE PER LINK 

200nsX = 2000ns = 2 ms = TOLERANCE FOR 100 

TANDEM TIME 
TRANSFERS 
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QUESTION AND ANSWER PERIOD 


MR. EASTON: 

We have five minutes, time for two questions. 

DR. KARTASCHOFF: 

I have one question about the propagation time delays. 

Do you have any data about pattern dependent jitter cable systems ? Because that 
is one problem which bothers the civilian communications when one works quite 
often over coaxial cable with, say, about a hundred pulse regenerative repeaters. 
There is not much data available, actually, about long term spectral density on 
the pattern dependent jitter. 

Do you have any data or do you have the same problem tiiat there is not much 
data available ? 

DR. STOVER: 

I don't have the data, but I know that it is very bad, so 1 would jump to the con- 
clusion initially that one of the other paths, through a satellite, will be better. 
Therefore it will be chosen as the reference, and the need for using the cable 
can be avoided in most cases. 

DR. KARTASCHOFF: 

Well, thank you veiy much, but you see, in the civilian systems we will use 
cable, and we will go Digital, too, in the next 20 years. So, this problem re- 
mains. It needs to be investigated. 

I think it must not necessarily be traumatic, but it is worse than microwave line 
of sight. 

DR. STOVER: 

I agree with that. As far as the Trans-Atlantic cable is concerned, again 1 come 
back to my statement about this being synergistic with all these other systems. 

If you are talking about, say, Trans-Atlantic, for example, and we are going to 
use Universal Time, you have already a reference in Europe that is much better 
than you could get across that cable. 
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So, there is a good reference there, and if you tie it into the network somehow, 
again you always use your best reference back to the Naval Observatory or 
whatever we use as our link with Universal Time. 

DR. COSTAIN: 

I understand in some of the networks they go via satellite one way and land line 
or microwave the other. You would have to have a third of a second discrimina- 
tion, I think, in the time differences for the two paths. 

DR. STOVER: 

Well, I am assuming that we will have a duplex link for all links. You are right. 
MR. LIEBERMAN: 

You talked strictly about time division multiplex. Wouldn't synchronous systems 
fit into this by regeneration ? 

DR. STOVER: 

There are large numbers of systems that will be compatible with this. All I am 
suggesting is that all of the nodes in the network have accurate time, and how 
we get it*there is— I suggested one instance there are other possibilities, of 
course, but I have tried to point out that using this system has some of its ad- 
vantages, just from this technique of getting it there, as well as advantages of 
having it there. Most other systems under consideration wouldn't even have it 
there. 

So, my first advocate is to have it there, and my second advocate is to provide 
a system similar to this for getting it there. 

MR. LIEBERMAN: 

One last question. 

What is the comparative cost of this versus some of the other systems you talked 
about? 

DR. STOVER: 

I believe that the cost of all the systems is somewhere in the same ballpark, 
because most of the equipment required to establish the synchronization is re- 
quired for any type of digital network. We always have to lock onto the frame 
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sync, and once }rou have got that, you have most of what we need, and as far as 
the accuracy of the clock, as I pointed out, the information we have permits us 
to use a lower precision clock, and operate on it with the information we have 
available to get a higher precision than wo otherwise would. 

So, I believe for the same accuracy it would cost less than some of the other 
approaches. But among all the approaches, 1 don't think the cost is a significant 
factor. 

DR. WINKLER: 

My comment is not related to your paper, but to Dr, Kartaschoff's question. 

At the Observatory, for purely internal reasons, we have made some tests using 
RG58 cable, coaxial cable. The effects which we found of course are in agree- 
ment with your comments, they are very bad. For a 10,000 foot loop above 
ground we found a diurnal change of about 10 to 20 nanoseconds, time delay. 

Now, that is average, using a relatively long time constant in the order of 1 sec- 
ond. The diurnal, of course, is completely thermal. 

We used these dabi only to assure ourselves that the clock time scale which util- 
izes underground cabling (less than 700') in between the clock vaults is not limited 
by these delays variations. 

But subsequent to that, I happen to have come into possession of some commer- 
cial literature on low temperature sensitive cables. It appears that there are 
some dielectric cables available which minimize these variations. I don't remem- 
ber where I have the information, but you may contact me on that. 

DR. KARTASCHOFF: 

Thank you very much. Dr. Winkler. 

The cable, that is one problem. I think that the worst problems in digital com- 
munications over a long cable line are the repeaters. The repeaters which at 
every end regenerate the pulse, and send it out again ir a nice form to the next 
repeaters and so on. For these repeaters, their average phase of the transition 
is dependent on the pulse pattern, that is on the content of the information which 
goes through the link and of course this is user dependent. 

So, you can have any form of pattern, and there can be very large excursions in 
the instant of time with which the information arrives at the end. 
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The general suggestion we have now in our discussions internal in our telecom- 
munications system is that we should try to absorb these delay variations by 
buffer memories, and use good oscillators for keeping the long term average 
rate constant. 

DR. STOVER: 

I agree that you want to absorb the variations with buffers. As far as the use of 
cables, again, I state, that in most cases, any of your major nodes will have 
other links coming in besides cable links, and they would be given a priority, 
and I am not suggestii^ that we use this distribution technique down to every 
TBX and everything. 

I am s\iggesting that all local groiips would be slaved to the thing. Only the ones 
that would have a number of links coming in from widely separated geographical 
locations would need to have the time reference distribution. 

All the ones that communicate primarily with one point would be slaved to ’t 
point. 

MR. EASTON: 

Thank you very much. Dr. Stover, for the fine paper. 
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